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The  Air  Force  places  a great  deal  of  emphasis  on  the  proper  selec- 
tion of  system  program  managers  for  its  multi-million  dollar  pro- 
grams. There  is  an  assumption  that  there  is  no  difference  in  the 
desired  qualifications  of  a system  program  manager  over  the  program 
acquisition  life  cycle  (conceptual,  validation,  full  scale  develop- 
ment, production,  and  deployment  phases).  This  assumption  is 
largely  unsubstantiated  in  the  literature.  This  study  conducted 
an  exploratory  evaluation  on  the  education,  experience,  and  mana- 
gerial trait  qualifications  desired  of  system  program  managers  over 
the  program  life  cycle.  Interviews  were  conducted  with  the  present 
system  program  managers  of  major  Air  Force  programs  to  obtain  data 
bearing  on  the  relationship  of  the  desired  qualifications  between 
the  individual  stages.  The  authors  concluded  from  an  analysis  of 
the  data  that  there  is  a difference  in  education  and  experience, 
but  not  of  managerial  trait  qualifications  desired  of  system  pro- 
gram managers  between  the  conceptual/validation  phase  and  the  full 
scale  development/production/deployment  phase.  The  research 
results  showed  that  the  primary  difference  lies  in  the  fact  that  an 
engineering  background  (education  and  experience)  is  preferred  in 
the  initial  stage  of  a program,  but  shifts  to  a management  back- 
ground (education  and  experience)  in  the  latter  stages. 
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CHAPTER  I 


INTRODUCTION 


Statement  of  the  Problem 


Contemporary  literature,  in  its  study  of  the  pro- 


gram manager’s  "modus  operandi,"  has  defined  the  manager's 


role  (*1:63),  but  contains  very  little  information  con- 


cerning the  major  qualifications  in  terms  of,  (1)  experi- 


ence, (2)  education,  and  (3)  managerial  traits,  desired 


of  a program  manager.  Furthermore,  what  is  found  in  the 


literature  tends  to  reflect  the  possibility  of  a dynamic. 


changing  nature  of  the  problems  facing  the  program  manager 


as  his  program  proceeds  from  its  inception  to  completion 


(2:93). 


The  identification  of  the  major  qualifications 


desired  of  a program  manager  at  various  stages  of  the 


acquisition  life  cycle  of  a program  would  provide  the 


basis  for  development  of  criteria  to  help  the  selection 


of  personnel  to  fill  key  program  management  positions. 


Definition  of  Terms 


Experience.  Activity  that  includes  training. 


observation  of  practice,  and  personal  participation  (12:83) 


Education.  The  state  of  training  and  developing 


knowledge,  skill,  mind,  and  character  (12:83). 


-J 


1 


2 

Managerial  traits  (personality).  Distinguishing 
qualities  or  characteristics,  especially  of  personality 
(12:84). 

Program.  Equipment  and/or  skills  together  with 
any  related  facilities,  services,  information,-  and 
techniques,  that  form  a complex  or  an  entity  capable  of 
performing  specific  operational  tasks  in  support  of 
identifiable  DoD  objectives  (23:2). 

Program  management.  A concept  for  the  technical 
and  business  management  of  particular  systems/programs 
based  on  the  use  of  a designated,  centralized  management 
authority  who  is  responsible  for  planning,  directing,  and 
controlling  the  definition,  development,  and  production 
of  a system/program  (23:2).  Throughout  this  study, 
program  management  will  be  used  synonomously  to  mean 
project  management,  matrix  management,  and  system  manage- 
ment unless  otherwise  indicated. 

Program  manager.  The  generic  term  used  to  denote 
the  single  Air  Force  manager  (System  Program  Director, 
Program/Project  Manager)  during  any  specific  phase  of  the 
acquisition  life  cycle  (24:4). 

Program  management  office.  The  organisation 
comprised  of  technical  and  business  management  and  admin- 
istrative personnel  assigned  full  time  to  a System/Program 
Manager.  The  office  may  be  augmented  with  additional 
personnel  from  participating  organizations  (23:2). 
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Functional  parity.  A basis  for  determining  the 
rank/grade  structure,  number  and  quality  of  personnel 
required  for  a System/Project  Management  Office  (23=3). 

Acquisition  life  cycle.  Normally,  consists  of 
five  phases  (Conceptual,  Validation,  Full-Scale  Development, 
Production,  and  Deployment)  with  three  key  decision  points 
(Program,  Ratification,  and  Production  Decisions)  between 
each  of  the  first  four  phases  ( 24 : ^ ) . 

Conceptual  phase.  The  initial  period  when  the 
technical,  military,  and  economic  bases  for  acquisition 
programs  are  established  through  comprehensive  studies 
and  experimental  hardware  development  and  evaluation  (2*1:4). 

Validation  phase.  The  period  when  major  program 
characteristics  are  refined  through  extensive  study  and 
analyses,  hardware  development,  test,  and  evaluations 
(24:4). 

Full-scale  development  phase.  The  period  when  the 
system/equipment  and  the  principal  items  necessary  for  its 
support  are  designed,  fabricated,  tested,  and  evaluated 
(24:4). 

Production  phase.  The  period  from  production 
approval  until  the  last  system/equipment  is  delivered  and 
accepted  (24:4). 


Deployment  phase.  The  period  beginning  with  the 
user's  acceptance  of  the  first  operational  unit  and 
extending  until  the  system  is  phased  out  of  the  inventory. 
It  overlaps  the  production  phase  (24:4). 

Concurrency.  The  overlapping  of  program  phases, 
such  as  undertaking  full  scale  development  before  the 
conceptual  phase  has  been  completed,  or  undertaking 
production  before  development  is  completed  (21:12). 

Program  Management  Directive  (PMD).  The  official 
Hq  USAP  management  directive  used  to  provide  direction  to 
the  implementing  and  participating  commands  and  satisfy 
documentation  requirements  (24:4). 

Program  Management  Plan  (PMP).  The  document 
developed  and  issued  by  the  Program  Manager  which  shows 
the  integrated  timephased  tasks  and  resources  required  to 
complete  the  task  specified  in  the  PMD  (24:5). 

Concept  of  Systems 

The  concept  of  systems  is  basic  to  this  thesis, 
both  in  understanding  the  importance  of  the  problem  and  in 
defining  the  terminology.  Systems  management  is  a term 
literally  used  and  intuitively  defined  by  many  people. 
Nevertheless,  it  may  be  of  value  in  assessing  the  scope  of 
the  program  manager's  responsibilities  to  define  and 
point  out  some  common  characteristics  of  systems.  Buffa 
(1 : 39), refers  to  a system  as  a "regularly  interracting  or 
interdependent  group  of  items  forming  a unified  whole." 
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Thus,  a system  may  have  many  components  and  elements 
(materials,  information,  machines,  people,  etc.)  which 
are  united  in  striving  toward  some  common  goal.  Applying 
the  systems  concept  to  design  and  development  is  widely 
accepted  by  the  Department  of  Defense  and  its  contractors. 
The  systems  concept  ±s  the  concept  of  a group  of  components 
designed  to  serve  intended  purposes  o. 1 missions  (17:1). 
Complexities  in  viewing  "systems1'  are  easily  envisioned 
(17:1).  Consequently,  it  is  of  paramount  importance  to 
the  Air  Force  that  proper  qualifications  are  determined 
for  individuals  heading  up  the  major  systems. 

Importance  of  the  Problem 

The  need  for  program  management . The  concept  of 
program  management  and  its  subsequent  implementation 
emerged  primarily  from  the  needs  and  problems  of  the 
Department  of  Defense  and  the  National  Aeronautics  and 
Space  Administration  (26:1).  Increased  sophistication, 
complexity,  and  cost  of  new  weapon  systems  has  served  to 
surface  program  management  as  a dynamic  management  system 
in  the  Air  Force  (14:61). 

In  an  age  when  technology  is  increasing  at  a 
geometric  rate,  and  resource  dollars  are  becoming  more 
and  more  scarce,  the  selectJon  of  program  managers  to 
meet  the  challenge  of  resource  management  is  of  crucial 
importance  (6:34).  In  FY  1973  Air  Force  Systems  Command 


(AFSC)  received  30JC  of  the  Air  Force  budget  (27).  As 
the  heads  of  the  principal  organizations  charged  with 
bringing  new  weapon  systems  into  being,  program  managers 
have  the  responsibility  for  efficient  utilization  of  much 
of  the  command’s  resource  dollars  (13:31). 

The  advancement  of  technology  in  all  phases  of 
industrial  management,  and  in  particular,  the  military 
industrial  complex  since  World  War  II  has  no  precedent. 
Since  radical  changes  occuring  in  the  design  and  develop- 
ment strategies  often  do  not  fit  the  purely  functional 
type  of  organization,  attention  is  now  being  given  to 
moulding  the  organization  around  the  task. 


A program  has  a distinct  life  cycle,  moving 
from  concept  formulation  and  definition  to 
acquisition  and  operation.  This  cycle  begins 
wish  a concept  feasibility  analysis,  progresses 
through  market  definition  and  production,  and 
ends  when  the  project  is  obsolete  or  nonexistent 
in  its  intended  environment  [4:70]. 

It  is  important  to  distinguish  between  program 
management  and  traditional/functional  management  in 
order  to  understand  the  profound  iroact  of  the  program 
management  concept  on  a new  management  style  for  par- 
ticular management  situations. 

Relationship  between  tradit.ional/functional 
management  and  program  management.  Traditional/functional 
management  functions  mostly  on  a vertical  basis,  and 
depends  almost  exclusively  on  a strong  Inviolate  superior- 
subordinate  relationship  to  insure  a unified  effort  (5:81) 
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However,  the  program  manager  crosses  functional  lines  to 
bring  together  the  management  activities  required  to 
accomplish  program  objectives.  The  program  manager’s 
authority  is  a combination  of  "de  jure"  in  the  sense  that 
it  exists  by  rightful  title,  and  "de  facto,"  which  is  the 
intrinsic  power  to  fully  discharge  responsibilities 
inherent  in  the  task  at  hand  (2:91). 

Program  management  is  compatible  with  the  tradi- 
tional/functional approach  to  management.  The  program 
manager  requires  full  support  from  the  functional 
organization  to  meet  his  program  ODjectives  and  the 
functional  manager  needs  the  program  requirements  to  meet 
functional  and  organizational  goals  (5:32).  Program 
management  has  provided  a way  of  thinking  about  management 
of  highly  technical  and  costly  products  whose  development 
and  acquisition  is  spread  across  several  large  autonomous 
organizations  (13:70).  In  the  total  sense,  program 
authority  is  comprised  of  both  the  legal  and  personal 
influence  that  the  program  manager  exercises  over  the 
cost,  schedule,  and  technical  considerations  of  the 
program  (5:84) • Figure  1 compares  the  traditional/ 
functional  style  of  management  with  program  management. 

Of  the  many  differences  between  traditional 


management  and  program  management  two  that  are  particularly 
important  to  the  program  manager’s  role  behavior  are: 


'wm  ,w»w 


Phenomenon 


Line-staff 

organi- 

zational 

dichotomy 


A web  of  authority 
and  responsibility 
relationships  exists, 


Scalar  Elements  of  the  ver- 

principle  tical  chain  exist, 

but  prime  emphasis 
is  placed  on  horizon- 
tal and  diagonal  work 
flow. 


Superior-  Peer  to  peer,  manager 

subordinate  to  technical  expert, 
relationship  associate  to  associate 
relationships . 


Organizational  Management  of  a pro- 
objectives ject  becomes  a joint 
venture  of  many 
relatively  independent 
obj ectives . 


Unity  of  The  project  manager 

direction  manages  across  func- 

tional and  organ- 
izational lines  to 
accomplish  common 
inter-organizational 
objective. 


Time  duration  The  project  is  finite 
in  duration. 


Parity  of 
authority 
and  respon- 
sibility 


Considerable  oppor- 
tunity exists  for  the 
project  manager’s 
responsibility  to 
exceed  his  authority. 
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Functional 

Line  functions  have 
direct  responsi- 
bility for  accom- 
plishing the  objec- 
tives; the  line 
commands,  staff 
advises. 

The  chain  of  author- 
ity relationships 
is  from  superior  to 
subordinate  throughout 
the  organization. 


All  important  bus- 
iness is  conducted 
through  a pyramid- 
ing structure  of 
superior-subordi- 
nates. 

Organizational  ob- 
jectives are  sought 
by  the  parent  unit 
working  within  its 
environment . 

The  general  manager 
acts  as  the  head  for 
a group  of  activities 
having  the  same  plan. 


Tends  to  perpetuate 
itself. 

The  integrity  of  the 
super  ior-subordinal  ^ 
relationship  is  main- 
tained throughout 
functional  authority. 


Figure  1. 


Functional  Versus  Program  Viewpoints  (*1:66) 
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(1)  the  program  manager’s  authority  vastly  exceeds  any 
that  could  be  delegated  under  the  concept  of  functional 
authority,  and  (2)  program  authority  unifies  all  organi- 
zational activities  regardless  of  where  they  are 
functionally  located  ( 9 : 31 ) • 

The  role  of  the  program  manager.  To  adequately 
analyze  and  evaluate  the  qualifications  desired  when 
selecting  a program  manager,  it  is  necessary  to  be 
acquainted  with  the  role  of  the  program  manager  and  its 
evolution. 

Forerunners  of  the  program  manager,  designated 
as  "project  expediters,"  did  not  perform  line  functions, 
but  rather  informally  motivated  those  persons  doing  the 
work  (5:18).  Ranked  slightly  above  the  project  expediter 
in  terms  of  time  and  responsibility  was  the  "project 
coordinator,"  who  had  a more  formal  role  in  the  organi- 
zation, and  was  concerned  with  the  synchronization  of 
organizational  activities  directed  toward  a specific 
objective  in  the  overall  functional  activities  (5:18). 

The  project  coordinator  did  not  actively  enter  into  the 
management  function  outside  of  his  particular  organization. 
(26:273). 

Today's  program  manager  is  in  every  sense  a manager; 
he  actively  participates  in  the  organic  functions  of 
planning,  organizing,  directing,  and  controlling  the 
organization  of  the  specific  program  (2:91).  He  prepares 


and  issues  a program  management  plan  (PMP)  in  consonance 
with  the  program  management  directive  (PMD)  (24:2). 
According  to  Gemmil  and  Thamhain,  the  program  manager 
accomplishes  the  management  process  through  other  managers. 

. In  this  arrangement  the  program  manager  has  authority 
over  the  functional  managers  with  respect  to  the  what  and 
when  of  the  program  activities.  Functional  managers  are 
in  turn  responsible  to  both  their  functional  supervisors 
and  the  program  manager  for  adequate  support  of  the 
program  (4:68). 

The  military  program  manager’s  role,  then,  is  to 
tie  together,  to  manage,  to  direct  the  development  and 
production  of  a system  meeting  performance,  schedule,  and 
cost  objectives  which  are  defined  by  his  Service  and 
approved  by  the  Secretary  of  Defense  ( SECDEF ) (14:73). 

The  essence  of  the  program  manager's  role  is  to  be  the 
agent  of  the  Service  in  the  management  of  the  System 
acquisition  process,  and  to  focus  the  authority  and 
responsibility  of  the  Service  for  operating  the  program. 

He  has  the  vantage  of  an  overall  perspective  of  the 
program  and  the  Interrelationships  among  its  elements. 

He  must  be  the  major  motive  force  for  propelling  the 
system  through  its  evo?.ution  (21:4).  The  breadth  of  the 
complexities  faced  by  the  program  manager  is  highlighted 
by  David  L.  Wilemon  in  his  article,  "Project  Management 
and  its  Conflicts:  A View  from  Apollo,"  (25:531)  in 

which  he  described  the  characteristics  of  program 


r 


11 

management  systems  as: 

1.  Problem  orientation.  . Program  management  is 
used  to  solve  specific,  complex,  identifiable  problems. 

2.  Multidisciplinary  focus.  Program  teams  are 
composed  of  a range  of  expertise  and  serve  as  a vehicle 
for  integrating  the  inputs  of  diverse  specialists. 

3.  Systems  perspective.  The  team  must  be  cog- 
nizant of  the  internal  workings  of  the  program  as  well  as 
the  larger  organizational  environment  of  the  project. 

4 • Horizontal/vertical  organizational  relation- 
ships. Program  management  is  a system  that  must  often 
operate  both  vertically  and  horizontally  with  its  ’'host" 
organization. 

5.  Finite  duration.  Piogram  organizations  are 
established  and  maintained  only  until  a task  is  completed. 
Once  the  program  objectives  have  been  achieved,  the  program 
team  is  disbanded. 

6.  Change  oriented.  Program  groups  must  be 
flexible.  Environments  change,  political  influences  change, 
budgets  change,  even  the  scope  of  problems  changes. 

7.  Innovation  in  organizational  design.  Complex 
tasks  often  require  one-of-a-kind  organization  structures. 


12 


8 . Responsibility  Identification.  Program 
management  employs  a deductive  approach  In  breaking  a 
task  down  Into  manageable  components.  Such  a system  aids 
in  establishing  a system  of  responsibility  and  accounta- 
bility for  each  project  task. 

Program  management  in  the  Air  Force.  A fundamental 
Department  of  Defense  (DoD)  policy  is  that  the  acquisition 
of  major  weapon  systems  will  be  directed  by  responsible 
managers  under  the  concept  of  program  management  (13:^). 

This  fundamental  policy  underlies  the  priority  and  atten- 
tion that  program  management  is  receiving  as  programs  get 
larger  and  more  sophisticated,  and  resources  become  in 
shorter  and  shorter  supply  ( 14 : 7 5 ) • 

The  Air  Force  has  over  100  weapon  and  support 
projects  classified  as  major  programs,  which  are  managed 
by  program  managers  with  the  grade  of  Lieutenant  Colonel 
through  Major  General  ( 14 : 6 ) . The  specific  grade  require- 
ment is  determined  through  a functional  parity  assessment 
of  the  task  at  hand.  These  Air  Force  program  managers  plan, 
organize,  and  control  the  development  and  acquisition  of 
weaponry  involving  billions  of  dollars  (5:81).  Program 
managers  are  supported  by  subsystem  managers  and  other- 
program  managers  throughout  the  research,  development  and 
production  complexes  of  governmental  and  industrial 
organizations.  Within  the  Air  Force  structure,  program 
managers  ere  identified  as  symbols  of  leadership  of  their 
programs  (5:86). 
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The  Deputy  Secretary  of  Defense  issued  a memo- 
randum stating: 

The  entire  management  problem  needs  to  be 
addressed  under  these  simple  guidelines:  put 

more  capable  people  into  program  management, 
give  them  the  responsibility  and  the  authority 
and  keep  them  there  long  enough  to  get  the  job 
done  [14:73. 

The  report  to  the  President  by  the  Blue  Ribbon 
Defense  Panel  stated: 

The  effectiveness  of  program  management  would 
be  improved  by:  developing  selection  and  training 

criteria  that  will  assure  the  availability  of  an 
adequate  number  of  qualified  officers.  The  criteria 
should  emphasize  achieving  a balance  between  needs 
of  a knowledge  of  operational  requirements  and 
experience  in  management;  also  providing  authority 
commensurate  with  the  assigned  responsibility  and 
more  direct  reporting  lines  for  program  managers 
[22:81]. 

In  a memorandum  entitled  ’’Policy  Guidance  on 
Major  Weapon  System  Acquisition”,  the  Secretary  of 
Defense  said: 

Management  in  the  services  will  be  improved  only 
to  the  extent  that  capable  people  with  the  right 
kind  of  experience  and  training  are  designated  to 
manage  these  major  programs.  If  capable  people 
are  going  to  be  willing  to  undertake  these  important 
program  management  assignments,  ways  must  be  found 
to  give  them  some  incentive  to  do  so.  Program 
managers  must  be  given  more  recognition  toward 
career  advancement  in  all  of  the  services,  and 
good  managers  must  be  rewarded  as  good  operational 
people  are  rewarded  [12:31-32], 


i Lt  General  Hudson,  Vice  Commander,  Air  Force 

i 

i Systems  Command,  recently  stated  that: 
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The  program  manager  is  the  key  to  program 
success.  VJe  at  APSC  put  a great  deal  of  emphasis 
on  selection  of  the  right  man  for  the  program 
manager’s  job  [14;55]. 

The  above  cited  policies  and  guidance  point  up 
the  importance  accorded  program  management  as  uniquely 
practiced  in  the  Air  Force. 

Unique  features  of  Air  Force  program  management 
The  unique  features  of  program  management  in  the  Air 
Force  are  primarily  disadvantages  which  compound  the 
complexities  already  inherent  in  a program  manager’s  job. 
The  following  unique  features  were  identified  by  the 
Logistics  Management  Institute  (LMI)  and  are  important  to 
keep  in  mind  when  evaluating  qualifications  of  a program 
manager  (14:49): 

1.  Program  managers  are  rotated  and/or  promoted 
to  otner  assignments  with  little  regard  to  program  life 
cycle.  Tenure  does  not-,  parallel  system  life  cycle. 

2.  In  general,  there  are  too  many  layers  of 
authority  between  program  managers  and  their  service 
secretaries.  Figure  2 illustrates  the  typical  layers  of 
authority. 

3.  The  program  manager's  grade  significantly 
enhances  his  stature  with  his  superiors  and  his  ability 

to  obtain  responsive  support  from  functional  organizations. 


SECRETARY  OF  THE  AIR  FORCE 
_ AIR  FORCE  CHIEF  OF  STAFF 
COMMANDER  AFSC* 


PROGRAM  DIRECTOR 


Figure  2.  Layers  of  Authority  Above  Program  Manager 


* Advisory  function  only,  not  program  direction 


(22:49). 


4.  There  is  no  protection  against  the  imposition 
by  organizations  below  the  level  of  the  chartering 
authority  of  across-the-board  personnel  reduc'i  ions-in- 
force,  bumping  chains,  etc. 

5.  Program  managers  spend  considerable  time  and 
effort  preparing  for  and  testifying  at  Congressional 
hearings  in  defense  of  their  programs  and  vying  for  resource 
dollars . 

6.  Seldom  is  a program  manager  at  an  organizational 
level  equal  in  rank  to  the  functional  elements  upon  which  he 
relies  for  support. 

7.  The  program  manager  does  not  have  sufficient 

authority  and/or  capability  to  control  funds,  budgeting 
and  scheduling  for  the  program  because  of:  (1)  congres- 

sional control  and  influence,  and  (2)  program,  not  line 
control  ove?  functional  areas.  Figure  3 shows  a typical 
program  office  organization  chart.  Figure  4 snows  program 
and  functional  authority  relationship. 


"»  ' w 


Line  Authority 
Project  Authority 


Figure  i|.  Program  and  Functional  Authority  Relationship 
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8.  Risk  assessment  is  usually  the  impetus  to  a 
program  management  organizational  structure.  Within  the 
Air  Force,  risk  assessment  equates  to  national  security. 

Summary 

This  brief  look  into  the  evolution  of  program 
management,  and  more  particularly  into  the  role  the  program 
manager  plays  within  the  complexities  of  the  program 
management  structure  and  the  prominence  program  management 
has  assumed  throughout  top  management  should  serve  to 
highlight  the  need  for  identifying  a minimum  set  of 
standards  desired  of  a program  manager.  These  standards 
are  particularly  necessary  if  there  is.  a difference  in 
qualifications  desired  during  various  stages  of  the  program 
life  cycle. 

This  section  has  served  tc  provide  background 
information  on  the  nature  of  project  management  in  the 
Department  of  the  Air  Force  by  tracing  its  evolution  and 
looking  at  the  Air  Force’s  recognition  of  the  need  to 
improve  the  quality  of  its  program  managers.  This  review 
sets  the  stage  for  efforts  to  examine  the  program  manager 
today,  survey  opinions  of  program  ranagers,  and  identify 
desired  program  manager  qualifications  at  different  stages 
in  the  program  life  cycle. 
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Objectives 

This  research  attempted  to  Identify  the  major  qual- 
ifications desired  of  a program  manager  during  the  differ- 
ent stages  of  the  life  cycle  of  a program.  Information 
was  collected  anu  evaluated  on  present  System  Program 
Office  (SPO)  managers.  The  data  was  categorized  with 
regard  to  the  stage  of  the  program  under  consideration  so 
that  differences,  if  any,  could  be  compared  and  tested. 

It  is  expected  that  the  resulting  information  may  be  used 
as  a bas^s  for  programming  educational,  experience,  and 
managerial  trait  requirements  irto  the  selection  and 
training  process  of  program  managers.  It  is  hoped  that 
this  research  effort  will  provide  the  Air  Force  with  a 
viable  "yardstick"  with  which  to  meet  the  challenge  of 
selecting  the  right  program  manager  for  the  right  job. 

Research  Hypotheses 

The  following  hypotheses  follow  from  the  identified 
importance  of  the  managerial  qualifications  of  the  program 
manager  and  the  unique  varying  tasks  associated  with  the 
different  stages  of  the  acquisition  life  cycle: 

1.  There  is  a difference  in  the  educational  qual- 
ifications desired  of  program  managers  between  stages  of 
the  acquisition  life  cycle. 

There  is  a difference  In  the  experience  qual- 


ifications desired  of  program  managers  between  stages  of  tne 
acquisition  life  cycle. 


3.  There  is  a difference  in  the  managerial  trait 
qualifications  desired  of  program  managers  between  stages 
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CHAPTER  II 


RESEARCH  METHODOLOGY 

General  Approach 

This  study  assessed  the  differences  in  the  major 
qualifications  desired  of  a program  manager  over  the  pro- 
gram acquisition  life  cycle  through  an  extensive  literature 
search  and  by  administering  a structured  interview  to 
program  managers  of  major  Air  Force  Weapon  System  Programs. 
The  interview  responses  were  rank  ordered,  in  order  of  their 
perceived  importance  to  the  interviewee,  and  statistical 
tests  were  made  on  the  data  for  measures  of  association/ 
agreement.  The  tests  of  association  are: 

1.  Spearman's  rank  correlation  coefficient  (19:202) 
was  used  as  a measure  of  association/agreement  among  inter- 
view rankings  to  determine  if  differences  exist  in  the 
major  qualifications  desired  of  program  managers  in  the 
young,  mature,  and  old  stages  of  the  acquisition  life  cycle. 

2.  Spearman's  rank  correlation  coefficient  was 
used  to  determine  the  degree  of  association  between  the 
interview  responses  based  on  the  product  center  assigned 
(i.e.,  ASD  versus  ESD,  etc.)  If  agreement  was  found  to 
exist,  it  was  assumed  there  was  no  bias  associated  with 
location/type  of  program,  and  thus  responses  from  all  three 
product  divisions  could  be  combined. 
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Method  of  Information  Collection 

The  two  primary  methods  us.ed  in  collecting 
information  for  this  study  were  library  research  and 
personal  interviews.  Figure  5 provides  a summary  of  the 
methodology  used  to  answer  the  research  hypotheses. 

Library  research.  The  authors  completed  a library 
search  using  the  following  topics:  program  manager,  pro- 

gram management,  systems  management,  matrix  management, 
system  program  directors  and  Air  Force  managers.  Research 
of  the  literature  resulted  in  an  ample  amount  of  both 
military  and  civilian  background  information  on  the  thesis 
topic . 

Personal  interview.  The  use  of  the  personal  inter- 
view imposes  certain  limitations  in  that  it  is  costly  in 
terms  of  time  and  human  bias.  The  many  advantages  of  an 
interview,  however,  outweigh  these  limitations.  One  of 
the  advantages  of  an  interview  is  that  this  technique 
enables  a high  percentage  of  returns  and  a better  sample 
than  might  be  collected  through  use  of  another  data  gather- 
ing procedure.  Frequently,  the  information  is  more  correct 
since  supplementary  information  can  be  collected,  and 
return  visits  can  be  accomplished,  if  necessary.  Another 
advantage  of  the  personal  interview  technique  in  this  study 
was  that  data  collected  was  classified  as  primary  since  it 
was  collected  by  the  researchers  functioning  in  tne  capacity 


of  interviewers . 


Diagram  of  Thesis  Methodology, 
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Of  all  the  advantages,  however,  perhaps  the  most 
Important  is  control.  Marshall  and  Pratt,  (15:19)  in  their 
thesis.  An  Analysis  of  Strategy  and  Tactics  Employed  in 
Contract  Negotiations,  viewed  the  Interview  as  far  more 
versatile  and  flexible  than  either  observation  or  the  use 
of  documents.  In  the  interview,  the  researcher  can  exert 
some  control  over  the  responses  of  the  informant.  In  cases 
of  ambiguity  in  the  responses  received,  the  interviewer 
can  seek  on-the-spot  clarification  and  not  be  dependent 
upon  his  recall  of  what  transpired  during  data  collection. 
Where  responses  are  inadequate,  the  interviewer  can  seek 
amplification.  Because  of  these  many  advantages,  the 
interview  was  selected  as  the  most  appropriate  technique 
for  the  collection  of  valid  data  to  test  the  research 
hypotheses . 

Information  Requirements 

The  following  null  hypotheses  were  tested: 

1.  There  is  no  difference  in  the  educational 
qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 

2.  There  is  no  difference  in  the  experience  qual- 
ifications desired  of  program  managers  between  stages  of 
the  acquisition  life  cycle. 

3.  There  is  no  difference  in  the  managerial  trait 
qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 


To  evaluate  these  hypotheses,  a measure  of 
association  was  made  of  the  major  qualifications; 
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education,  experience,  and  managerial  traits  desired  by 
major  program  managers.  The  qualifications  identified 
were  correlated  with  the  stages  of  the  acquisition  life 
cycle.  For  the  purposes  of  this  study  the  stages  of  the 
acquisition  life  cycle  v.’ere  defined  to  be:. 

1.  Young . Includes  the  conceptual  and  validation 

phases . 

2.  Mature.  Represents  the  Full-Scale  Development 

Phase. 

3.  Old.  Includes  the  production  and  deployment 

phases. 


The  realigning  of  the  stages  of  the  acquisition 
life  cycle  was  done  for  two  reasons;  (1)  for  the  ease  of 
data  collection  and  comparison,  and  (2)  redefinition  of  the 
phases  into  the  young,  mature  and  old  stages  represent  the 
major  program  threshold  decision  points  (2*1:2) . In  this 
context  a decision  point  is  the  point  in  time  that  a "go” 
or  "no-go"  decision  is  made  to  proceed  to  the  next  phase 
of  the  program  (24:2). 

Normally  the  acquisition  life  cycle  consists  of 
all  five  steps  (conceptual,  validation,  full-scale  develop- 
ment, production,  and  deployment),  but  not  all  programs 
I'ollow  a prescribed  path.  A program  may  skip  a phase, 
have  program  elements  in  any  or  all  other  phases,  or  have 
multiple  decision  points  per  phase  (24:2). 


It  was  felt  that  the  program  decision  points  were 


the  critical  milestones  of  each  program  and  provided  a more 
distinct  reference  point  from  which  to  compare  the  data 
base.  The  information  obtained  identified  the  character- 
istics desired  in  each  of  the  major  qualification  areas 
and  was  classified  into  one  of  the  life  cycle  stages  for 
comparison  and  testing  of  the  hypotheses. 

Population  Under  Study 

General.  The  population  of  the  study  under  consid- 
eration included  all  major  Air  Force  defense  programs  so 
designated  by  the  Secretary  of  Defense/Deputy  Secretary  of 
Defense  and  identified  by  definition  in  Department  of 
Defense  (DoD)  Directive  5000.1  to  be  (21:1): 

1.  Dollar  value  (programs  which  have  an  estimated 
RDT&E  cost  in  excess  of  50  million  dollars,  or  an  estimated 
production  cost  in  excess  of  200  million  dollars. 

2.  National  urgency. 

3.  Recommendations  by  DoD  Component  Heads  or 
Office  of  Secretary  of  Defense  (OSD)  officials. 

Program  managers  studied.  The  data-produclng 
sample  consisted  of  Air  Force  System  Program  Managers  whose 
programs  met  the  above  criteria.  This  sample  consisted  of 
the  entire  population  under  study  and  hence  was  repre- 
sentative of  that  population. 
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System  program  managers  interviewed  included  the 
System  Program  Directors  (SPDs)  of  major  programs  at  Air 
Force  System  Command's  (AFSC)  three  major  product 
divisions:  (1)  Electronic  Systems  Division  (ESD),  Hanscom 

Field,  Massachusetts;  (2)  Aeronautical  Systems  Division 
(ASD),  Wright-Patterson  AFB,  Ohio;  and  (3)  Space  and 
Missile  Systems  Organization  (SAMSO)  Los  Angeles  Air  Force 
Station,  California.  Figure  6 illMstrates  the  position  of 
the  three  product  cent  rs  within  the  Air  Force  organi- 
zational structure.  Figures  7,  8,  and  9 show  the  organi- 
zational positions  interviewed  by  product  division,  ASD, 

ESD,  and  SAMSO,  respectively. 

Data  Base  and  Data  Validity 

The  data  was  obtained  from  personal  interviews 
with  each  of  the  directors  of  major  weapon  system  programs 
indicated  previously. 

The  rank  and  position  of  program  managers  was 
assumed  to  be  adequate  to  validate  data  gathered  via  the 
prime  source.  More  specifically,  the  rank  and  position 
held  by  members  of  the  population  was  assumed  to  qualify 
them  to  identify  those  characteristics  most  helpful  in  the 
performance  of  their  duties. 


Figure  9.  Space  and  Missile  Systems  Organizational  Positions  Interviewed 
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Variables  Under  Consideration 

The  variables  studied  were  experience,  education, 
managerial  traits  and  stage  of  acquisition  life  cycle.  The 
first  three  are  dependent  variables  and  are  categories  of 
characteristics  selected  because  of  their  encompassing 
nature  and  critical  impact  as  discussed  below.  Each 
dependent  variable  was  categorized  into  a discrete  limited 
number  of  characteristics  for  purposes  of  measurement.  The 
individual  characteristics  are  nominal  in  nature,  but  when 
rank  ordered,  the  resulting  data  is  on  an  ordinal  scale. 

The  fourth  variable,  stage  of  acquisition  life  cycle,  is 
the  independent  variable,  nominal  data,  representing  three 
separate  stages  over  which  the  dependent  variables  >.  ere 
evaluated.  Figure  10  shows  the  relationship  between  the 
dependent  and  independent  variables.  Specific  rationale 
for  selection  of  each  of  the  variables  measured  include: 
Education.  Education  was  selected  as  a dependent 
variable  because  of  the  many  diversified  functional  dis- 
ciplines both  under  the  program  manager's  pcivi.w,  and 
those  outside  of  his  line  of  authority  for  which  he  re- 
quires support  (24:54).  For  example,  the  program  manager 
must  be  cognizant  of  the  financial  requirements  and  con- 
trols, mast  be  aware  of  personnel  manning  and  managing, 
be  able  to  critically  review  engineering  design  and 
evaluation,  and  be  a systems  integrator.  The  degree  and 
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Figure  10.  Independent  and  Dependent  Variable  Relationships 
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academic  area  desired  was  focused  on  the  graduate  level. 

The  basis  for  this  choice  was  the  preponderance  of  data 
from  library  research  which  indicated  the  necessity  of  a 
graduate  degree  for  a project  manager  (20:29;  7:48;  3:19). 

Information  pertaining  to  desirable  education  for  managers, 
both  military  and  industrial,  point  out  the  need  for  both 
technical  and  business  adrr.inistrat ion/management  training 
and  expertise.  A basic  assumption  was  made  that  pros- 
pective SPDs  v.\ uid  possess  a technical  background,  via  a 
scientific,  mathematical,  or  engineering  bachelor's 
degree.  This  assumption  is  backed  up  by  previous  studies 
in  the  same  area  which  have  indicated  that  over  99#  of 
SPDs  have  a formal  technical  baccalaureate  degree  (3:19). 

For  r-his  reason  the  undergraduate  degree  was  not  considered 
as  a variable  for  purposes  of  questioning.  The  inter- 
viewees were  advised  of  this  assumption  in  each  case.  I 

Specific  selection  cf  responses  available  were  derived 
from  other  surveys,  questionnaires,  and  interviews 
relating  to  similar  topics  of  Investigation  (12:41;  7:62; 

3:74).  Specifically,  to  evaluate  educational  qualifi- 
cations desired  of  a program  manager,  interviewees  were 
asked  to  rank  order  (priority  1 through  5)  such  graduate 
degree  programs  as:  Business  Management,  Personnel 

Management,  Financial  Management,  Operations  Research  and 
Engineering. 
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Experience . This  variable  was  selected  for  study 
and  comparison  because  of  the  complex  nature  of  the  program 
manager's  job.  Por  example,  the  program  manager  functions 
as  a central  activity  dealing  with  many  echelons  above  his 
program  up  to,  and  including,  the  Secretary  of  the  Air 
Force  as  well  as  the  functional  agencies  and  user  commands 
(12:42).  The  interviewee  was  asked  to  rank  order  (priority 
1 through  4)  the  following  characteristics: 

(1)  Headquarters,  Air  Staff,  Numbered  Air  Force  experience; 

(2)  Command  or  operational  experience;  (3)  Engineering/ 
Laboratory  experience;  or  (4)  System  program  management 
experience.  The  characteristics  used  were  selected  from 


similar  studies  (3=19;  1 ‘4l). 


. Managerial  traits 


was  the  most  difficult  of  the  three  variables  to  evaluate. 
The  search  for  characteristics  that  spell  success  in  men 
in  leadership  or  executive  roles  is  not  a recent 
phenomenon.  Socrates  advanced  temperance,  courage,  justice 
and  wisdom  as  the  virtues  that  make  men  good  (20:23). 
Homer's  writings  reflected  justice,  judgement,  wisdom, 
craft,  and  valor  as  the  qualities  of  leadership.  Extensive 
library  research  of  works  by  Likert,  Sayles,  and  others 
produced  approximately  60  desirable  managerial  traits. 

Many  were  similar  or  nearly  Identical  in  meaning.  The 
authors  narrowed  this  list  down  to  a total  of  seven.  The 
traits  selected  were  felt  to  be  sufficiently  representative 


of  those  researched  as  to  encompass  a wide  range  of 
characteristics  desired.  In  three  of  the  seven  traits 
similar  meanings  were  combined  so  as  to  convey  a more 
accurate  description  of  the  desired  managerial  traits. 

As  a result,  it  was  assumed  a more  meaningful  delineation 
of  traits  was  achieved.  Specifically  for  this  thesis,  to 
evaluate  the  quality  characteristics  desired  of  a program 
manager,  interviewees  were  asked  to  rank  order  (priority 
1 through  5)  such  qualities  as:  communicative  skill, 

decision  making  ability  (decisiveness),  imagination, 
motivation  (himself  and  others)  and  self  confidence. 

Stage  of  acquisition  life  cycle.  Detailed 
definitions  and  explanations  of  the  various  stages  of 
the  life  cycle,  (young,  mature,  old)  were  provided  in 
detail  in  the  Information  Requirements  section  of  this 
thesis.  Suffice  it  to  say  that  desired  qualifications 
of  program  managers  may  change  as  stage  of  program  life 
cycle  and  predominant  managerial  tasks  change. 

Research  Instrument 

As  previously  mentioned,  a structured  interview 
was  used  to  gather  the  data  required  for  testing  the 
hypotheses.  (See  Appendix  A.)  The  interview  instrument 
consisted  of  two  parts;  (1)  a basic  general  background 
section  on  the  interviewee,  and  (2)  the  major  qualification 
section,  with  experience,  education,  and  managerial  trait 
questions . 


The  interviewees  were  asked  to  rank  order  the  major 
qualifications  in  the  order  of  importance  toward  meeting 
the  objectives  of  the  program  management  stage  of  the  life 
cycle  under  observation.  The  rank  ordered  data  obtained 
from  the  interview  is  ordinal  in  nature  thereby  suitable 
for  measure  of  association  (agreement)  testing  described 
in  detail  in  the  Testing  the  Hypotheses  chapter  of  this 
thesis. 

Pilot  Study  of  the  Structured  Interview 

The  authors  conducted  a pilot  study  of  the  research 
instrument  on  Wright-Patterson  AFB,  Ohio.  Several  inter- 
viewees were  selected  from  the  program  managers  of  the 
smaller  program  offices  and  directorate  level  chiefs  of 
the  major  programs  under  study.  Many  constructive  comments 
were  made  which  led  to  the  reorganizing  of  questions  on 
the  interview.  Expert  guidance  was  received  from  these 
individuals  pertaining  to  questioning  techniques  which  they 
felt  would  be  most  effective.  Reliance  on  uheir  experience 
and  judgement  led  to  a deletion  of  ambiguous,  confusing,  or 
irrelevant  questions  on  the  test  instrument. 

Interview  Methodology 

The  interviewee  was  initially  advised  of  the  purpose 
of  the  interview,  then  was  handed  a sheet  of  paper  with  a 
list  of  responses  to  the  various  questions.  He  was  assured 
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that  his  responses  would  be  grouped  with  those  of  other 
interviewees,  and  was  guaranteed  total  anonymity  so  as  to 
minimize  biases  and/or  prejudices  which  could  result  from 
the  subject  feeling  that  he  was  being  compared  to  other 
program  managers.  If  this  were  the  case  he  might  respond 
to  the  interview  questions  as  he  would  perceive  other 
program  managers  would,  and  not  necessarily  express  his 
own  real  feelings.  Each  interviewee  was  asked  to  respond 
for  the  stage  in  the  life  cycle  in  which  he  felt  that  he 
was  particularly  knowledgeable  or  experienced  in.  Each 
interviewee  could  thus  answer  for  1,  2,  or  3 stages  of 
the  life  cycle. 

The  interviewee  was  also  advised  that  concurrency 
was  acknowledged  across  the  spectrum  of  the  life  cycle, 
but  that  for  purposes  of  demarcation  of  major  go-no-go 
decision  points,  the  cycle  was  partitioned  into  three 
stages  instead  of  the  traditional  five;  (1)  conceptual 
and  validation  (young),  (2)  full-scale  development  (mature), 
and  (3)  production  and  deployment  (old).  He  could  then 
presumably  formulate  his  answers  with  the  three  stages 
in  mind. 
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Assumptions 

1.  The  sample  was  confined  to  major  program 
offices  on  the  assumption  that  results  gained  from  the 
analysis  would  not  be  inapplicable  for  smaller  program 
offices.  This  assumption  is  based  on  the  premise  that  if 

a program  manager  can  manage  a large  complex  program  he  can 
also  manage  a smaller,  simpler  program,  and  in  fact,  prob- 
ably has. 

2.  Education,  experience  and  managerial  trait 
factors  are  the  inclusive  major  qualifications  required  of 
a program  manager. 

3.  The  data  collected  for  this  study  is  valid. 

This  assumption  is  based  on  an  examination  of  the  process 
by  which  the  data  is  generated,  collected  and  accumulated 

as  described  in  the  section  of  this  thesis  in  the  Population 
Under  Study  section.  The  time  limits  on  this  study  did  not 
allow  a rigorous  validation  of  the  generated  data. 

4.  The  management  concept  based  on  type  of  pro- 
gram, aircraft  versus  missile,  etc,,  is  not  signii icar.tly 
different  with  respect  to  its  influence  on  data  collection. 

5.  The  program  manager  in  the  population  observed 
was  qualified  in  his  present  position,  and  therefore  was 
qualified  to  identify  the  major  qualifications  needed  to 
accomplish  his  job. 
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Limitations 

The  study  was  limited  to  the  top  program  manage- 
ment offices  in  the  Air  Force,  which  provided  a manage- 
able basis  from  which  to  evaluate,  analyze,  and  predict 
those  characteristics  required  of  a program  manager.  As 
a consequence,  the  results  of  the  study  can  be  considered 
to  be  directly  applicable  to  Air  Force  program  management 
only.  Inference  to  other  services  will  be  a matter  of 
judgement  on  the  part  of  the  reader. 


CHAPTER  III 
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TESTING  THE  HYPOTHESES 

Introduction  to  Data  Analysis 

As  previously  mentioned  In  this  thesis,  data  was 
collected  in  the  form  of  rank  ordered  interview  responses 
from  major  program  managers.  Each  interviewee  rank  ordered 
his  preferences  in  each  of  three  different  categories, 
i.e.,  education,  experience,  and  managerial  traits,  for 
each  stage  in  the  acquisition  life  cycle  for  which  he  felt 
he  was  qualified  tc  comment  or..  The  authors  determined 
that  if  a program  manager  provided  responses  for  a partic- 
ular stage  of  the  life  cycle,  and  had  less  than  one  year 
of  experience  in  that  stage,  his  response  was  purged  from 
the  data  base.  The  one  year  minimum  experience  criteria 
in  each  stage  was  verified  by  interview  questions  and 
complimentary  research  of  biographical  information.  Upon 
completion  of  the  data  purging,  the  dat \ base  consisted  of 
interviews  with  twenty-four  System  Program  Directors. 

(See  Appendix  B.) 

Compilation  of  Data 

Interviewees  were  asked  to  respond  with  their 
selections  in  order  of  preference,  1 through  *J,  of  the  four 
available  choices  in  the  Experience  category.  They  were 

Hi 
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also  asked  to  rank  order  1 through  5 of  those  available 
choices  in  both  the  Education  and  Managerial  traits 
categories.  Although  there  were  11  and  7 available  choices, 
respectively,  in  the  Education  and  Managerial  Trait 
categories,  it  was  felt  that  validity  of  selection  would  be 
considerably  lessened  after  the  first  five  selections.  In 
other  words,  each  succeeding  selection  would  become  less 
relevant  to  the  interviewee  in  terms  of  discrimination 
between  available  choices. 

Concern  over  possible  variation  due  to  differences 
between  product  centers  b^Ci.jse  of  geographical  location 


j and/or  program  differences  led  the  auu.  't*s  to  test  for 

* 

agreement  between  centers.  A comparison  of  data  between 

f 

{ 

product  centers  was  accomplished  using  the  Spearman  rank 
| correlation  coefficient.  Jt  was  concluded  that  no  damaging 

• bias  was  present,  and  that  the  data  could  be  combined  for 

1 

j testing.  (See  Appendix  C.) 

t 

r 

Rank  Orc.erlng  Procedure 

Rank  orderings  l'or  all  categories  were  then  in- 
verted, thus  making  the  first  choice  the  highest  number, 
and  the  last  choice,  number  one.  This  inversion  was 
necessary  to  minimize  the  bias  that  might  occur  when  an 
alternative  was  not  chosen,  or  chosen  only  a few  t.mes 
The  values  of  characteristics  in  each  category  were 
totalled  to  give  composite  values.  These  composite  values 
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were  then  rank  ordered  with  the  highest  value  considered  to 
be  the  highest  rank.  The  composite  values  were  functions 
of  both  frequency  of  selection  of  characteristics  and  the 
relative  preference  accorded  by  each  interviewee.  The 
rank  orderings  were  used  as  the  measures  of  comparison 
between  the  stages  of  the  life  cycle.  Rank  orderings  were 
obtained  for  each  of  the  three  categories,  i.e.,  education, 
experience,  and  managerial1  traits  in  each  of  the  three 
stages  (young,  mature,  and  old)  of  the  acquisition  life 
cycle.  This  :1assification  of  rank  orderings  thereby 
allows  each  dependent  variable  to  be  subdivided  into  three 
subsets,  one  for  °ach  category  of  the  independent  variable. 
Thus,  the  education  variable  could  be  considered  to  be 
composed  of  the  three  subsets:  desired  educational 

qualifications  in  the  young  stage,  educational  qualifi- 
cations in  the  mature  stage,  and  educational  qualifications 
ir.  the  old  stage.  The  experience  variable  and  the  man- 
agerial traits  variable  were  similarly  treated.  This 
classification  of  rank  orderings  thereby  provided  nine 
distinct  variables  (Figure  11)  which  were  then  used  to 
test  the  three  hyf ^theses  identified  in  Chapter  I. 

Rationale  for  Use  of  Spearman  Rank 
Correlation  Coefficient 

In  parametric  statistics,  the  usual  measure  oi 
correlation  is  the  Pearson  product-moment  correlation 
coefficient  (r).  This  statist!  requires  scores  or  values 
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Figure  11.  Variables  Under  Measurement 


which  represent  measurement  in  at  lea:.t  an  interval  scale 
(19:195).  Since  interval  scales  of  measurement  were  not 
met  in  the  data,  the  use  of  a nonparametric  correlation 
coefficient  was  necessary.  Several  nonparametric  measure: 
are  potentially  applicable  when  nominal  or  ordinal  data  is 
available  (19:30).  The  Spearman  rank  correlation 
coefficient  is  a frequently  used  nonparametric  test  that 
is  applicable  when  two  rank  ordered  individuals  or  ejects 
are  compared  to  each  other  for  a measure  of  association  or 
agreement  (19:202).  Specific  reasons  for  the  use  of  the 
Spearman  rank  correlation  coefficient  in  this  research 
are: 

1.  It  requires  m assumptions  concerning  the  shape 


of  the  population  from  which  the  i et  of  values  is  taken 
(19:31). 
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2.  It  requires  only  measurement  of  values  on  an 
ordinal  scale  (10:839).  Ordinal  measurement  means  that  the 
numerical  values  obtained  give  information  only  about 
relative  magnitudes  of  she  underlying  variable,  and  arith- 
metic differences  between  values  have  no  particular 
significance  (10:8lH). 

3.  The  computations  required  to  determine  the 
coefficient  are  neither  complicated  nor  extensive  (19:33). 
This  was  a decided  advantage  considering  t!  ■»  number  of 
tests  performed. 

The  coefficient,  sometimes  called  rho,  is  repre- 
sented here  as  rg,  and  can  vary  from  -1.0,  perfect  negative 
correlation,  i.e.,  perfect  disagreement,  to  + 1.0,  perfect 
positive  correlation  or  agreement. 


The  Spearman  Test 

The  basic  methodology  employed  in  using  the  test 
is  to  rank  order  two  variables  in  ordor  of  preference  by  N 
choices  as  in  X-^,  X 2,  Xg,...  X^,  and  Y-p  Y,....Y^. 

Then  a measure  of  correlation  is  used  to  determine  the 
relation  between  the  X’s  a~  1 Y’s.  An  indication  of  dis- 
parity in  the  rankings  is  observed  by:  - Y^ . If 

the  relation  between  the  two  rankings  were  perfect,  each  D 
would  be  z^o.  The  larger  the  Dj^s,  the  less  perfect  is 
the  relationship  between  the  two  variables.  In  computing 


1 correlation  coefficient,  it  is  more  convenient  to  use 
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D c instead  of  D in  order  to  eliminate  the  cancellation 
i i 

effects  of  positive  and  negative  D^’s  (19:202). 

The  formula  selected  to  compute  the  Spearman  r is: 

s 


r 


s 


N ? 
6IDi 2 
1=1 

N3  - N 


(19:20*0 


Setting  of  Acceptance  Level 

The  level  of  agreement  between  two  variables  will 
vary  from  -3.0  to  +1.0.  Inferences,  may  be  drawn  based 
upon  the  value  plus  the  sign  of  the  computed  r . For 
example,  if  the  computed  value  was  -,75»  one  could  'nfer 
disagreement  in  the  rankings  of  the  N factors  by  the  two 
groups,  as  did  Marshall  and  Pratt  (15:29-30),  thus  implying 
a lack  of  consistency  in  rankings.  However,  if  the 
computed  value  of  rs  was  +.75,  one  could  logically  infer 
that  there  was  a strong  agreement  between  the  ranking  of 
the  N factors  by  the  two  groups,  and  thus,  the  ranking  by 
or.e  group  was  consistent  with  that  oi  the  other  group.  An 
rs  of  0.0  Indicates  an  intermediate  condition  of  no 
agreement  in  either  direction.  The  authors  selected  an  rg 
of  .75»  which  was  considered  to  be  sufficiently  large  to 
indicate  substantial  agreement  of  the  rankings  compared. 


Hypothesis  Test  Format 

If  the  Spearmar  rank  correlation  coefficient  (rs) 
were  found  to  be  equal  to  or  greater  than  .75,  there  would 
be  no  reason  to  reject  tne  null  hypothesis.  If  the  r0 

o 

value  were  found  to  be  less  than  .75,  the  null  hypothesis 
would  be  rejected  and  the  research  hypothesis  would  be 
supported. 

The  following  format  is  used  to  present  the  Test 
of  Research  Hypothesis  ’’ections:  (1)  restatement  of  the 

research  hypothesis;  (2)  restatement  of  the  null  hypothe  is; 
(3)  presentation  of  data;  and  '4)  interpretation  of 
findings . 

Test  of  Research  Hypothesis  Mo.  1 

P^sc^temenc  of  ;he  research  hypothesis.  The 
research  hypothesis  tested  v» 

HI:  There  is  a difference  in  the  educational 

qualifications  desired  of  program  managers  between  stages 
of  t:he  acquisition  life  cycle. 

Restatement  of  the  null  hypothesis.  The  research 
hypothesis  tested  in  its  null  form  is: 

HO:  There  is  no  diff  ..once  in  the  educational 

qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 


Presentation  of  'lata.  The  values  of  the  Spearman 
rank  correlation  coefficient  (rs)  for  comparison  of  rank 
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orderings  of  educational  qualifications  between  stages  of 
the  acquisition  life  cycle  are  presented  below: 


stage  versus  stage 


value  of  r 


young  versus  mature 
young  versus  old 


mature  versus  old 


-.02 


Interpretation  cf  findings.  <*s  presented  above  , 

the  r values  for  the  young  versi s mature,  and  young  versus 
s 

old  stages  '.re  both  less  than  .75.  Therefore,  in  accord- 
ance with  the  decision  rule,  it  was  concluded  that  there 
is  a difference  in  the  educational  qualifications  desired 
of  program  managers  between  the  young  and  mature  stages, 
and  between  the  young  and  old  stages  of  the  acquisition 
life  cycle.  The  computed  r_  value  for  the  mature  versus 
old  stage  is  greater  than  .75.  Therefore,  in  accordance 
wi^ n the  decision  rule,  there  is  no  diff  rence  in  the  edu- 
cational qualifications  desired  of  program  managers  between 
the  mature  old  stages  of  the  acquisition  life  cycle. 
Thus,  the  research  hypothesis  was  supported  for  the  yvung 
versus  mature,  and  young  versus  old,  but  not  supported  for 
the  mature  versus  old  stages  of  the  acquisition  life  cycle. 


Test  of  Research  Hypothesis  No.  2 


Restatement  of  the  research  hypothesis.  The 


research  hypothesis  tested  was: 


HI:  There  is  a difference  in  the  experience 
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qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 

Restatement  of  the  null  hypothesis.  The  research 
hypothesis  tested  in  its  null  form  is: 

HO:  There  is  no  difference  in  the  experience  qual- 

ifications desired  of  program  managers  between  stages  o° 
the  acquisition  life  cycle. 

Presentation  of  data.  The  values  cf  the  Spearman 
rank  correlation  coefficient  (rs)  for  comparison  of  rank 
orderings  of  experience  qualifications  between  stages  of 
the  acquisition  life  cycle  are  presented  below: 


stage  versus  stage 


value  of  rs 


young  versus  mature  -.2 
young  ■'ersus  old  -.2 
mature  versus  old  1.0 


Interpretation  of  findings.  As  presented  above, 
the  rg  values  for  the  young  versus  mature  and  young  versus 
mid  stages  are  both  less  than  .75  Therefore,  in  accordance 
with  the  decision  rule,  it  was  concluded  that  there  is  a 
differeace  in  the  experience  qualifications  desired  of  pro- 
gram managers  between  the  young  and  mature  stages,  and 
between  the  young  and  old  stages  of  the  acquisition  life 
cycle.  The  computed  r„  value  for  the  mature  versus  old 
stage  is  greater  than  .75.  Therefore,  in  accordance  with 
the  decision  rule,  there  is  no  difference  in  the  experience 
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qualifications  desired  of  program  managers  between  the 
mature  and  old  stages  of  the  acquisition  life  cycle.  Thus, 
the  research  hypothesis  was  supported  for  the  young  versus 
mature,  and  young  versus  old,  but  not  supported  for  the 
mature  versus  old  stages  of  the  acquisition  life  cycle. 


Test  of  Research  Hypothesis  No.  3 

Restatement  of  the  research  hypothesis.  The 
research  hypothesis  tested  was: 

HI:  There  is  a difference  in  the  managerial  traits 

qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 

Restatement  of  the  null  hypothesis.  The  research 
hypothesis  tested  in  its  null  form  is: 

HO:  There  is  no  difference  ir.  the  managerial  traits 

qualifications  desired  of  program  managers  between  stages 
of  the  acquisition  life  cycle. 

Presentation  of  data.  The  values  of  the  Spearman 
rank  correlation  coefficient  (rs)  for  comparison  of  rank 
orderings  of  managerial  traits  qualifications  between  stages 
of  the  acquisition  life  cycle  are  presented  below: 


stage  versus  stage 


value  of  rc 


young  versus  mature 
young  versus  old 


mature  versus  old 


Interpretation  of  findings.  As  presented  above, 
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|rs  values  for  all  '“omparisons  are  greater  than  .75.  There- 
fore, in  accordance  with  the  decision  rule,  there  is  no 
difference  in  the  managerial  trait  qualifications  desired 
of  program  managers  at  different  stages  of  the  acquisition 
life  cycle.  Thus,  there  was  no  reason  to  reject  the  null 
hypothesis . 
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CHAPTER  IV 

CONCLUSIONS  AND  RECOMMENDATIONS 
FOR  FUTURE  STUDY 

Introduction 

This  chapter  presents  the  conclusions  related  to 
research  hypotheses  No.  1,  2,  and  3.  Included  also  are 
recommendations  for  further  research. 

Research  Hypothesis  No.  1 Findings 

Table  1 summarizes  the  findings  cited  in  Chapter 
III  relative  to  desired  educational  qualifications  of  pro- 
gram managers  (Research  Hypothesis  No.  1). 

TABLE  1 

Research  Hypothesis  No.  1 Findings 


Test 

Test  Results 

Comparison  of  Stages 

Computed 

rs 

Decision 

Rule 

Interpre- 

tation 

Young  versus  Mature 
Young  versu.-  Old 
Mature  versus  Old 

.16 

-.02 

.95 

less  than 
.75 

less  than 
.75 

less  than 
.75 

Supported 

Supported 

Mot 

Supported 
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Research  Hypothesis  No.  1 Conclusions 

As  shown  in  table  1,  there. is  a difference  in  the 
educational  qualifications  desired  of  program  managers 
between  the  young  and  mature,  and  the  young  and  old  stages 
of  the  acquisition  life  cycle,  but  not  between  the  mature 
and  old  stages.  A practical  interpretation  of  this  differ- 
ence is  found  by  looking  at  the  raw  data  responses,  which 
indicated  an  overwhelming  emphasis  on  engineering  disci- 
plines in  the  young  stage  of  the  life  cycle;  whereas  pri- 
mary emphasis  was  placed  on  the  management  disciplines  in 
the  mature  and  old  stages. 

Research  Hypothesis  No.  2 Findings 

Table  2 summarizes  the  findings  cited  in  Chapter 
III  relative  to  desired  experience  qualifications  of  pro- 
gram managers  (Research  Hypothesis  No.  2). 

TABLE  2 


Research  Hypothesis  No.  2 Findings 


Test 

Test 

Results 

Comparison  of  Stages 

Computed 

rs 

Decision 

Rule 

Interpre- 

tation 

Young  versus  Mature 

-.20 

less  than 
.75 

Supported 

Young  versus  Old 

-.20 

less  than 
.75 

Supported 

Mature  versus  Old 

1.00 

less  than 
.75 

Not 

Supported 
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Research  Hypothesis  No.  2 Conclusions 

As  shown  in  table  2,  there. is  a difference  in  the 
experience  qualifications  desired  of  program  managers 
between  the  young  and  mature,  the  young  and  old  stages  of 
the  acquisition  life  cycle,  but  not  between  the  mature  and 
old  stages.  A practical  interpretation  is  easily  dis- 
cernible as  was  the  difference  in  the  educational  qualifi- 
cations desired. 

The  composite  rank  ordering  of  desired  experience 
characteristics  selected  by  program  managers  in  the  young 
stage  by  priority  was;  (1)  Engineering/Laboratory  exper- 
ience, (2)  System  Program  Management  experience,  (3)  Head- 
quarters/Air Staff  experience,  and  (4)  Command/Cperational 
experience. 

In  the  mature  and  old  stages,  which  had  a direct 
one-to-one  agreement  (perfect  association),  the  rank 
ordering  by  priority  was;  (1)  System  Program  Management 
experience,  (2)  Headquarters/Air  Staff  experience,  (3)  Com- 
mand/Operational experience,  and  (4)  Engineering/Labora- 
tory experience. 

As  can  be  seen  from  the  rank  orderings,  the  sig- 
nificant difference  lies  in  the  fact  that  Engineering/Lab- 
oratory experience  was  the  first  choice  in  the  young  stage, 
but  ranked  last  in  the  mature  and  old  stages.  With  this 
one  exception,  the  remaining  experience  characteristics 
were  in  the  same  relative  order  of  importance. 

Stated  in  general  terms,  program  managers  preferred 
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Engine -ring/Laboratory  experience  in  the  young  stage,  but 
placed  it  as  least  preferred  in  the  mature  and  old  stages. 
This  change  of  preference  placed  System  Program  Management 
experience  as  the  most  desired  in  the  mature  and  old  stages , 

Research  Hypothesis  No.  3 Findings 

Table  3 summarizes  the  findings  of  ted  in  Chapter 
III  relativ  ■ to  managerial  trait  qualifications  of  program 
managers  (Research  Hypothesis  No.  3)* 

TAELE  3 

Research  Hypothesis  No.  3 Findings 


Test  Results 


tation 


Conclusions 


As  shown  in  table  3,  there  is  no  significant  diff- 
erence ir  the  managerial  traits  desired  of  program  managers 
between  any  of  the  stages  cf  the  acoulsition  life  -ycle. 

In  fact , there  is  a very  high  agreement  (assoc  ^atici.)  from 
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one  tage  to  another  of  the  managerial  traits  desired  of  a 
program  manager. 

Overall  Findings 


Table  A summarizes  the  findings  cited  in  Chapters 
III  and  TV,  relative  to  educa.ional,  experience,  and  mana- 
gerial traits  desired  for  program  managers. 

TABLE  4 


Overall  Research  Hypotheses  Find4ngs 


rs  Comparison  by  Stages 

Qualifications 

Young 

versus 

Mature 

Young 

versus 

Old 

Mature 

versus 

01c 

Education 

Experience 

Managerial 

Traits 

.I6a 
- .20a 

mm 

.95 

L.wC 

.99 

O 

CO 

• 

CO 

t— 

• 

aResearch  Hypothesis  Supported  r3  < .75 

Note:  Entries  not  supporting  the  research  hypoth- 

esis ar-*  enclosed  in  double  lines  for  ease  of  anal- 
yst s/c  ompar i s c n . 
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Overall  Conclusions 

It  is  not  feasible  to  have  three  program  managers; 
one  with  the  desired  education  qualifications,  one  with  th>- 
desired  experience  qualifications  and  one  with  the  desired 
managerial  trait  qualifications  for  each  stage  of  the  life 
cycle.  This  research  has  not  tried  nor  doe*'  it  show  any 
such  conclusion.  This  study  does  conclude  however,  that 
there  is  a definable  point  in  the  acquisition  life  cycle 
that  it  is  logical  and  perhaps  necessary  (because  of  the 
relative  magnitude  of  disagreement)  tc  change  the  SPO 
manager  based  upon  his  particular  backgrour...  This  defin- 
able point  is  found  between  the  young  and  nature  stages. 

Even  though  the  research  centered  around  comparing 
the  categories  of  qualifications  between  three  stages, 
table  4 shows  little  or  no  difference  in  the  second  and 
third  stages;  mature  and  old,  x espectively . This  allows 
conclusions  to  be  made  treating  the  mature  and  old  stages 
as  one. 

Table  4 shows  there  is  no*  onlv  a difference  but  a 
substantial  difference  in  the  education  and  exper4  .»nce 
qualification*  desired  of  a program  manager  in  the  young 
stage  (conceptual  and  validation  phases)  versus  the 
education  and  experience  qualifications  desired  of  a 
program  manager  In  the  mature/old  stages  (full-scale 
development,  production  and  deployment  phases).  The  table 
shows  little  or  no  differences  in  managerial  traits 
desired  between  stages. 
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To  illustrate  the  differences  mentioned  I - may  be 
beneficial  to  contrast  the  desired  image  of  a program 
manager  in  each  stage. 

Desired  qualifications  of  a program  manager  during 
the  young  (conceptual  and  validation)  stage.  It  w as  con- 
cluded that  a program  manager  ^.aould  have  a strong  engi- 
neering background  during  the  conceptual  and  validation 
stage  both  from  the  educational  as  well  as  experience 
standpoint.  This  emphasi  - . _ems  logical  in  view  of  the 
heavy  engine  ring  concentration  arried  on  during  the  early 
development  of  a weapon  system  program. 

Desired  ouallf Icatlons  of  a program  manager  during 
the  mature  (full-scale  development)  and  old  (production 
deployment)  stage.  This  study  concluded  that  once  the 
program  decist tn  point  is  reached  (between  validation  and 
full-sca-e  development  phase)  and  go-ahead  is  given,  there 
is  an  overwhelming  shift  from  • ngineering  emphasis  in  the 
desired  education  and  experience  qualifications  to  that  of 
managerial  emphasis,  particularlv  in  the  financial  and 
personnel  management  areas. 


Recommendations  for  Future  Research 

It  is  recommended  that  additional  exploratory 
research  be  conducted,  employing  the  methodology  and 
conclusions  found  in  this  study  along  with  the  objective 


evaluation  of  each  SPDs  actual  performance  for  possible 
correlation.  For  example,  do  General:  with  prior  unit 


commander  experience  but  no  Hq  Staff  experience  perform 
bettex  than  officers  with  Kq  Staff  experience  and  no 
command  experience? 
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APPENDIX  A 

STRUCTURED  INTERVIEW 
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APPENDIX  A 

QUALIFICATIONS  DESIRED  OF  AN  AIR  FORCE 
PROGRAM  MANAGER  DURING  PHASES 
OF  THE  LIFE  i iCLE 

MASTER  THESIS  STRUCTURED 
INTERVIEW 


OBJECTIVE 

The  objective  of  this  interview  is  to  obtain  responses  to 
questions  relating  to  characteristics  of  education, 
experience,  and  managerial  traits  desired  of  program 
managers  during  stages  of  the  acquisition  life  cycle.  The 
responses  will  be  rank  ordered  as  to  preference  of  the 
interviewee  and  grouped  with  responses  from  other  program 
directors  for  measures  of  association  between  acquisition 
life  cycle  stages. 


i 
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STRUCTURED  INTERVIEW 

Name 

Interviewee Date 

Position Grade 

1.  What  stage  of  the  acquisition  life  cycle  is  your  program. 

a.  Young  (Conceptual  and  validated)  

b.  Mature  (Full-scale  development)  

c.  Old  (Production  and  deployment)  

2.  How  long  have  you  been  in  your  present  assignment? 

a.  Less  than  6 months  

b.  6 months  to  one  year  

c.  Over  one  year  to  two  years  

d.  Over  two  years  to  three  years  

e.  Over  three  years  

3.  Based  on  your  experience  which  five  of  the  following 
graduate  level  majors  (priority  ?.  through  5)  do  you 
feel  best  prepare  a project  manager  for  the  young/ 
mature/old  stage  of  acquisition? 

a.  Busir.f  ss  Adir.ini -tration  

b.  Financial  Management  

c.  Industrial  Managt  r.ent  

d.  Personnel  Management  

e.  Systems  Management  

f.  Electrical  Engineering  

g.  Meehan. cal  Engineering  

h.  Operations  Rese  irch  


i. 


Mathematics 


j.  Science  (specific  field 

k.  Engineering  (specific  field 

l.  Other  (specific  field 


) 

) 
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4.  Based  on  your  experience,  rank  in  order  of  importance 
(1  through  4)  the  experience  levels  desired  of  the 
program  manager  in  the  young/mature/old  stage  of 
acquisition. 

a.  Command/operational  experience 


b.  Headquarters,  Air  Staff,  Numbered 
Air  Force 

c.  Engineering/laboratory  experience 


d.  System  program  management  experience 


e.  Other  (specify) ) 


5.  Based  on  your  experience,  rank  order  (1  through  5)  the 
managerial  traits  you  feel  are  most  desired  of  the  pro- 
gram manager  in  the  young/mature/old  stage  of 
acquisition. 

a.  Communicative  skill 


b.  Decision  making  ability  (decisiveness) 


c.  Imagination,  creativity 

d.  Motivation,  aggressivness  (himself 
and  others) 


e.  Risk-taker  (versus  conservative) 


f.  Human  relations  skills 


g.  Flexibility 

h.  Other  (specify) ) 


i 
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INTERVIEWEE  RESPONSE  WORK  SHEET 

A.  BUSINESS  ADMINISTRATION  

B.  FINANCIAL  MANAGEMENT  

C.  INDUSTRIAL  MANAGEMENT  

D.  PERSONNEL  MANAGEMENT  

E.  SYSTEMS  MANAGEMENT  

F.  ELECTRICAL  ENGINEERING  

G.  MECHANICAL  ENGINEERING  

H.  OPERATIONS  RESEARCH  

I.  MATHEMATICS  

J.  SCIENCE  (SPECIFIC  FIELD ) 

K.  ENGINEERING  (SPECIFIC  FIELD ) 

L OTHER  (SPECIFIC  FIELD . ) 


A.  COMMAN D/OPERATIONAL  EXPERIENCE 

B.  HEADQUARTERS,  AIR  STAFF,  NUMBERED  AF 

C.  ENGiNEERING/UBORATORY  EXPERIENCE 

D.  SYSTEM  PROGRAM  MANAGEMENT  EXPERIENCE 

E.  OTHER  (SPECIFY) 
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COMMUNICATIVE  SKILL 

DECISIONMAKING  ABILITY 
(DECISIVENESS) 

IMAGINATION,  CREATIVITY 

MOTIVATION,  AGGRESSIVENESS 
(HIMSELF  AND  OTHERS) 

RISK-TAKER  (VS  CONSERVATIVE) 

HUMAN  RELATIONS  SKILLS 

FLEXIBILITY 

OTHER  (SPECIFY 


APPENDIX  B 

ORGANIZATIONAL  POSITIONS  INTERVIEWED 

Aeronautical  Systems  Division  (ASP) 

Deputy  for  Reconnaissance/Strike/Electronic  Warfare 
Deputy  for  Systems 
Deputy  for  SRAM  (AGM-69) 

Deputy  for  SCAD  (AGM-86) 

Deputy  for  Sub-Systems 
Deputy  for  F-15 
Deputy  for  B-l 
Deputy  for  C-5A 
Deputy  for  A-10 
Deputy  for  Prototype 

Electronic  Systems  Division  (ESP) 

Deputy  for  Airborne  Command  Post 
Deputy  for  AWACS 

Deputy  fcr  Communications/Navigation  Systems 
Deputy  for  Planning/Technology/Standardization 
Deputy  for  Surveillance  Control  Systems 
Deputy  for  Iranian  Programs 

Space  and  Missile  Systems  Organization  (SAMSO) 

< Deputy  for  Development  Plans 
Deputy  for  Technology 
Deputy  for  Launch  Vehicles 

Preceding  page  blank 
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Deputy  for  Spec'al  Defence  Systems 

Deputy  for  Special  Communication  Systems 

Deputy  for  Reentry  Systems 

Deputy  for  Mirr-teman 

Deputy  for  Defense  Satellite  Systems 


APPENDIX  C 

PRODUCT  CENTER  BIAS  CHECK 
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APPENDIX  C 


BIAS  CHECK  WITH  PRODUCT  CENTERS 

The  Spearman  rank  correlacion  method  was  used  tc 
measure  the  level  of  agreement  between  each  of  the  three 
product  centers,  ASD,  ESD,  and  SAKSG  within  each  stage  of 
the  acquisition  life  cycle.  The  results  showed  that  there 
was  a considerab’e  level  of  agreement  among  Product  centers 
for  each  qualification  in  each  stage  of  the  life  cycle, 
with  one  exception.  Tht*  level  of  agreement  between  ESD 
and  ASD,  and  between  ESD  and  SAMSO  was  very  low  in  the 
young  stage  of  the  acquisition  cycle  for  mar..'  al 

trait  qualifications.  ESD  interviewees  differed  with 
respect  tc  their  ASD  and  SAKSO  counterparts  in  that  they 
placed: 

1.  Less  emphasis  on  motivation/aggressiver^ss  in 
an  SPD  for  the  young  stage. 

2.  More  emphas's  on  imagination/creativity  in  an 
SPD  for  the  young  stage. 

3.  Less  emphasis  on  ^ecision-making  in  an  SPD  for 
the  yov^g  stage. 

The  authors  decided  to  eliminate  the  ESD  computations  from 
the  data  base  to  evaluate  its  effects  on  the  measurement  of 
agreement  previously  computed.  The  eli;  ination  of  this 
data  did  not  change  the  initial  conclusions,  and  in  fact. 
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actually  shewed  a higher  level  of  agreement  between  stages 
of  the  life  cycle,  as  shown  below: 


Data  Base  of 

Managerial  Traits 

Young 

versus 

Mature 

Young 

versus 

Old 

Mature 

versus 

Old 

ESD  Included 

.36 

.78 

.99 

ESD  Removed 

.96 

.96 

1.00 

Hence,  inclusion  of  the  LSD  interviewees'  responses 
in  the  data  base  provided  no  reason  to  reject  the  null 
hypothesis. 
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APPENDIX  D 

SPEARMAN’S  COMPUTATIONS 

This  appendix  c'-tif.ies  in  detail  the  data  and  steps 
taken  to  compute  r^  (10:84l-S45;l9:20?-213)  for  each  stage 
versus  stage  ~ ^nparison.  hhe  following  steps  were 
accomplished  in  order: 

1.  Rank  orderings  b.v  interviewees. 

2.  Composite  totals  and  overall  rank  orderirgs. 

p 

3.  Computation  of  for  uach  characteristic 

for  stage  versus  stage  comparison. 

4.  Computation  of  rs. 

The  rank  orderings  of  preferences  are  indicated  for 
each  interviewee.  Each  interviewee  was  assigned  a numbe” 
along  with  a letter  identifying  his  product  center,  i.e  , 
(A)  ASD,  one  through  ten;  (E)  ESD,  one  through  six;  and 
(S)  SAMSO , one  through  eight.  In  descending  order  of 
preference,  rankings  are  from  the  highest  number  down  to 
the  lowest.  In  case  of  Mes,  mean  ranks  were  assigned 
to  sets  of  ties;  ’"hat  is,  when  two  or  more  objects  were 
tied  ir.  order,  each  was  assigned  the  mean  of  the  ranks 
they  would  nave  otherwise  occupied.  Data  has  been 
summarized  in  the  three  categories  for  each  stage  in  the 
life  cycle,  as  follows: 

Precelin  mi  Mink 
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Composite  total  values  were  then  computed  for  each 
stage  of  the  life  cycle.  Individual  rank  orderings  were 
totalled  for  each  characteristic  of  each  category.  The 
same  computations  were  made  for  each  stage  in  the  life 
cycle.  Totals  for  each  characteristic  along  with  the 
overall  ranking  within  that  category  are  indicated  by 
the  following: 


Education 

Young  Stage 

Mature 

Stage 

Old  St 

age 

Total 

Rank 

Total 

Hank 

Total  hank 

Business 

Admin- 

istration 

18 

4 

57 

6 

47.5 

5 

Financial 

Management 

29 

5 

73 

7 

73.5 

7 

Industrial 

Management 

14 

2.5 

42 

5 

54 

6 

Personnel 

Management 

6 

1 

9 

1 

11 

2 

Systems 

Management 

63 

6 

111 

8 

104 

8 

Electrical 

Engineering 

95.5 

8 

23.5 

3 

11.5 

3 

Mechanical 

Engineering 

90.5 

7 

19.5 

2 

7.5 

1 

Operations 

Research 

14 

2.5 

25 

4 

21 

4 

80 


t 


; 

Experience 

Young  Stage 

Mature 

Stage 

Old 

Stage 

: 1 

Total 

Rank 

Total 

Rank 

Total 

Rank 

Command/ 

Operational 

31 

1 

42 

2 

46 

2 

i* 

! 

Hq./Air  Staff/ 
NAF 

46 

2 

64 

3 

59 

3 

' 

Engineer/ 

Laboratory 

73 

4 

40 

1 

28 

1 

System  Program 
Management 

70 

3 

94 

4 

87 

4 

. 

Managerial 

Traits 

■ 

! 

| Communication 

i Skills 

69 

6 

84 

6 

86 

6 

* 

t* 

j Decision  Making 

‘ Ability 

85 

7 

104 

7 

98 

7 

1 

| Imagination/ 

5 Creativity 

56 

5 

23 

3 

18 

2.5 

| Motivation/ 

| Aggressive 

48 

4 

54 

4 

44 

4 

t 

1 Risk  Taker 

4 

1 

9 

1 

7 

1 

| Human  Relations 

f 

42 

3 

64 

5 

59 

5 

[ 

i Flexibility 

26 

2 

17 

2 

18 

2.5 

i 

! 


Stage  versus  stage  comparisons  were  then  made  of 
overall  rank  orderings.  A Dj  2 was  computed  for  the  rank 
difference  for  each  characteristic.  For  instance,  in  the 
young  stage  Business  Administration  was  ranked  fourth;  in 
the  mature  stage,  it  was  ranked  sixth.  Therefore,  the 
was  2.  The  values  were*  tnen  squared.  Resulting 
values  were  summed  as  indicated  below: 
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Education 

Young 

Young 

Mature 

versus 

versus 

versus 

Mature 

Old 

Old 

°i 

V; 

Di2  L 

} . 

1 

V 

Business  Administration 

2 

4 

1 

1 

1 

1 

Financial  Management 

2 

4 

2 

4 

0 

0 

Industrial  Management 

2.5 

6.25 

3.5 

12.25 

1 

1 

Personnel  Management 

0 

0 

1 

1 

1 

1 

Systems  Management 

2 

4 

2 

4 

0 

0 

Electrical  Engineering 

5 

25 

5 

25 

0 

0 

Mechanical  Engineering 

5 

25 

6 

36 

1 

1 

Operations  Research 

1.5 

2.25 

1.5 

2.25 

0 

0 

IV 

70.5 

85.5 

4 

Experience 

Command/Operational 

1 

1 

1 

1 

0 

0 

Hq./Air  Staff/NAF 

1 

1 

1 

1 

0 

0 

Engineer/Laboratory 

3 

9 

3 

9 

0 

0 

System  Program  Mgt. 

1 

1 

1 

1 

0 

0 

IV 


12 


12 


0 


8? 


Managerial  Traits 


Communication  Skills 


Decision  Making  Ability 
Imagination/Creativity 
Motivation/ Aggressive 
Risk  Taker 


Human  Relations 


Flexibility 

IV 


The  following 


j rs  * I" 

j 

i 

! 

I 


Young 

versus 

Mature 

Young  Mature 
versus  versus 
Old  Old 

h 

Ei.2 

D_i  V £i 

Ed 

0 

0 

0 0 0 

0 

0 

0 

0 0 0 

0 

2 

4 

2.5  6.25  .5 

.25 

0 

0 

0 0 0 

0 

0 

0 

0 0 0 

0 

2 

4 

2 4 0 

0 

0 

0 

.5  .25  .5 

.25 

8 

10.5 

.5 

formula  was  used  to  compute  rs: 
N 

1=1 

N3  - N 


(19:204), 

where  N was  the  number  of  characteristics  in  each  category, 

and  as  computed  previously.  For  example,  in  consider- 

2 

lng  education  in  young  versus  mature,  Dj^  is  70.5  and  N is 
eight.  Therefore,  computations  are: 


All  other  computations  are  carried  out  in  the  same  manner 


The  resultant  rg  values  are: 


Category 

Young 

versus 

Mature 

Young 

versus 

Old 

Mature 

versus 

Old 

Education 

.16 

-.02 

• 95 

Experience 

-.20 

-.20 

1.00 

Managerial  Traits 

.86 

.78 

.99 

SELECTED  BIBLIOGRAPHY 


i 


i 

r 


i 


A.  REFERENCES  CITED 


1.  Buffa,  Elwood  S.  Modern  Production  Management. 

New  York:  John  Wiley  and  Sons  Inc . ,1969. 

2.  Butler,  Arthur  G.  Jr.  "Project  Management:  A Study  in 

Organizational  Conflict,"  Academy  of  Management 
Journal,  XVI,  1 (March,  1973)*  84-99. 

3.  Chambers,  Major  John  E.,  Major  Donald  W.  Henderson, 

Major  Glenn  A.  Jones,  and  Marvin  L.  Solomon. 

"The  System  Program  Director  of  the  Seventies." 
Unpublished  Systems  Analysis,  University  of 
Southern  California,  1970. 

4.  Cleland,  David  I.  "Understanding  Project  Authority," 

Business  Horizons,  X,  1 (Spring,  1967),  63-70. 

5.  . "Whv  Project  Management?"  Business 
Horizons , VII,  4 (Winter 1 1964),  81-88'. 

6.  Cook,  Desmond  L.  Educational  Project  Management. 

Columbus,  Ohio:  Charles  E.  Merrill  Co.,  1971. 

7.  Esterby,  Captain  Brian  E.  "Project  Ace  Finding  48: 

Development  of  Experienced  Program  Managers." 

Plans  Division,  Directorate  of  Personnel  Plans, 
Headquarters  Air  Force  Systems  Command,  1974. 

8.  Gemmill,  Gary  and  David  L.  Wi lemon.  "The  Power 

Spectrum  in  Project  Management,"  Sloan  Management 
Review,  XII,  1 (Fall,  1970),  15-25. 

9.  Hanna,  John.  Project  Management  in  an  Educational 

Environment ♦ Proceedings  of  th*  Project  Management 
Institute  Seminar/ Symposium,  St.  Louis,  Missouri 
(October,  1970). 

10.  Hays,  William  L.  and  Robert  L.  Winkler.  Statistics : 

Probability,  Inference  ami  Decision.  New  York: 
Holt,  Rinehart  and  Winstrn,  Inc.,  1971. 


Preceding  page  blank 

65 


- 


86 


11.  Helmstadter,  G.C.  Research  Concepts  In  Human  Behavior. 

New  York:  Meredith  Corp.,  1970. 

12.  Loftus,  Lieutenant  Commander  Thcmas  Joseph  and 

Lieutenant  Commander  Benjamin  E.  Allen.  "Career 
Development  of  the  Navy  Project  Manager.” 

Unpublished  Master’s  thesis.  Naval  Postgraduate 
School,  Monterey,  California,  1973. 

13.  Logistics  Management  Institute.  Introduction  to 

Military  Program  Management.  LMI  Task  69-28. 
Washington  D.C. , 1971. 

14.  Logistics  Management  Institute.  The  Program  Manager 

Authority  and  Responsibilities.  LMI  Task  J2-b. 
Washington  D.C.,  1972. 

15.  Marshall,  Captain  Harvey  A.  and  Captain  Robert  J.  Pratt. 

"An  Analysis  of  Strategy  and  Tactics  Employed  in 
Contract  Negotiations."  Unpublished  Master’s 
thesis.  School  of  Systems  and  Logistics,  Air  Force 
Institute  of  Technology  (AU),  Wright-Patterson 
AFB,  Ohio,  1974. 

16.  Mee,  John  F.  "Ideational  Items,"  Business  Horizons, 

Fall,  1963,  PP.  53-54 • 

17.  Morgan,  Clifford  T.  Human  Engineering  Guide  to 

Equipment  Design.  New  York:  McGraw-Hill  Book 
Company , Inc. ,1963 . 

18.  Sheer,  Wilbert  E.  "Executive  Success,"  Personnel 

Journal , XXXXVI,  3 (March,  1967),  l4 4-149". 

19.  Siegel,  Sidney.  Nonparametrlc  Statistics  for  the 

Behavioral  Sciences.  New  York:  McGraw-Hill 
Book  Company,  Inc.,  1956. 

20.  Solberg,  Major  Harold  A.  and  Major  Charles  J.  Stiner. 

"A  Review  and  Analysis  of  System  Program  Office 
Manager’s  Experience  and  Training,  and  Its 
Relation  With  the  Man-Machine  Concept." 

Unpublished  Master’s  thesis,  School  of  Systems 
and  Logistics,  Air  Force  Institute  of  Technology 
(AU),  Wright-Patterson  AFB,  Ohio,  1972. 

21.  U.S.  Department  of  Defense.  Acquisition  of  Major 

Defense  Systems.  Department  of  Defense  Directive 
5000.1  Washington,  D.C.:  Government  Printing 
Office,  1971. 


' €r\7TT  T7^r„ 


^7^^  V*^?7' 


87 


22.  U.S.  Department  of  Defense,  Report  to  The  President 

and  the  Secretary  of  Defense  on  the  Department  of 
Defense.  Blue  Ribbon  Defense  Panel.  Washington, 
b.C. : Government  Printing  Office,  1970. 

23.  U.S.  Department  of  Defense.  System/Project  Management. 

Department  of  Defense  Directive  50107X57  V, 'ashing- 
ton,  D.C.:  Government  Printing  Office,  1965. 

24.  U.S.  Department  of  the  Air  Force.  Program  Management. 

AF  Regulation  800-2.  Washington,  D.C.:  Government 
Printing  Office,  1972. 

25.  Wilemon,  David  L.  "Project  Management  and  Its  Con- 

flicts: A View  From  Apollo Chemical  Technology, 
II,  9 (September,  1972),  527-5W. 

26.  . "The  Project  Manager:  Anomalies  and 

Ambiguities,"  Academy  of  Management  Journal, 

XIII,  3 (September  197077" 269-282 . 

27.  Zambenini,  Colonel  Robert  L.  Comtroller,  Aeronautical 

Systems  Division  (ASD),  Wright-Patterson  AFB, 

Ohio,  Personal  Interview.  October  10,  1974. 


B.  RELATED  SOURCES 


Avots,  I.  "Why  Does  Project  Management  Fail?" 

California  Review.  XII  (Fall,  1969),  77-82. 

Bridges,  Charles  M.,  Jr.  and  Woodrow  W.  Wyatt.  Statistics 
for  the  Behavioral  Sciences.  Boston:  D.C.  Heath  and 
Company,  1966. 

Cleland,  D.I.  and  W.R.  King.  Systems  Analysis  and  Project 
Management . New  York:  McGraw-Hill  Book  Company,  19bBT 

Davies,  Peter  (ed.).  The  American  Heritage  Dictionary  of 
the  English  Language^  New  York:  Dell  Publishing'  Co.7 
Inc.,  1970. 

De  Paolis,  Lt  Colonel  Thomas  A.,  Major  James  R.  Sampson, 
Major  Warren  K.  Stobaugh,  Captain  Marcus  D.  Scharf,  and 
Norman  L.  Uhlman.  "Criteria  for  the  Selection  of 
Personnel  for  the  System  Program  Office."  Unpublished 
Research  Paper,  School  of  Systems  and  Logistics,  Wright- 
Patterson  AFB,  Ohio,  1965* 


88 


Drucker,  Peter  P.  The  Effective  Executive.  1st  ed.  New 
York:  Harper  & Row,  1967. 

Emory,  William  and  Powell  Niland.  Making  Management 
Decisions.  Boston:  Houghton  Mifflin,  19687 

Esposito,  Brigadier  General  A.L.  “Career  Progression 
for  Potential  SPDs."  Headquarters  Air  Force 
Systems  Command  Letter,  Andrews  '.FB,  Maryland, 

1*1  September  1971* 

Peatherston,  Captain  Frank  H.  “This  Business  of 

Project  Management,”  U.S.  Naval  Institute  Proceedings, 
LXXXXVIII,  1 (January,  1972),  23-29. 

Folsom,  Marion  Bayard.  Executive  Decision  Making, 
Observations  and  Experience  in  Business  and 
Government . Hew  York:  McGraw-Hill,  1962. 

Gaddis,  Paul  0.  "The  Project  Manager,"  Harvard  Business 
Review,  XXXVII  (June,  1959),  89-97. 

Gorden , Raymond  L . , Ph . D . Interviewing — Strategy, 

Techniques,  and  Tactics.  Homewood,  111.:  The  Dorsey 
Press,  1965. 

Griffin,  John  I.  Statistics  Methods  and  Applications. 

New  York:  Holt,  Rinehart  and  Winston,  1962. 

Halter,  Albert  N.  and  Gerald  W.  Dean.  Decisions  Under 
Uncertainty.  Cincinnati:  South-Western  Publishing 
Co.,  1971. 

Hamburg,  Morris.  Statistical  Analysis  for  Decision 
Making.  Chicago:  Harcourt,  Brace  and  World,  Inc., 
1970. 

Haygood,  Lieutenant  Colonel  William  Z.  "Inspector 
General  Evaluates  Program  Management."  Defense 
Industry  Bulletin,  VII  (Summer,  1971),  51-53. 

Hast,  Fremont  E.  and  James  E.  Rosenzweig.  Organization 
and  Management:  A Systems  Approach.  New  York: 
McGraw-Hill  Book  Company,  1970. 

Keato,  E.S.  "How  to  Become  a Good  Project  Manager," 
Aerospace  Management,  August,  1963.  pp.  20-23. 


89 


Kendall,  Maurice  G.  and  Alan  Stuart.  The  Advanced  Theory 
of  Statistics,  Vol.  II.  New  York:  Hafner 
Publishing  Company,  1967. 

Lawrence,  Paul  R.  and  Jay  W.  Lorsch,  ’’New  Management 
Job:  The  Integrator,”  Harvard  Business  Review. 

XXXXV,  1 (November-Dee  ember  ,“”1967 ) , 15  2-151 . 

. Organization  and  Environment:  Managing 

Differentiation  and  Integration.  Homtwood,  Illinois: 
Richard  D.  Irwin,  Inc.,  1969. 


Noether,  Gottfried  Emanuel.  Elements  of  Nonparametrlc 
Statistics . New  York:  Wiley,  1967. 

Parker,  Colonel  Levin  W.,  Jr.  "The  Defense  Systems 

Management  School:  A Nev;  Concept  in  Program  Manager 
Training."  Defense  Management  Journal,  VII  (Pall, 
1971),  50-53. 


Peloquin,  Major  Dale  B and  Major  Arthur  J.  Roscoe 

"Systems  Management  in  the  United  States  Air  Force — 

A Review  and  Critical  Analysis."  Unpublished  Master's 
thesis.  School  of  Engineering,  Wright-Patterson  AFB, 
Ohio,  1969. 

Peppers,  Jerome  G.  and  Ernest  W.  Spitzer,  "Developing 
Military  Executives."  Air  University  Review,  XX 
(May-June,  1969),  34-35 . 


Pierce,  Albert.  Fundamentals  of  Nonparametrlc  Statistics. 
Belmont,  Calif.:  Dickenson  Publishing  Co.,  1970. 


Richardson,  Stephen  A.,  Earbara  Snell  Dohrenwend,  and 
David  Klein.  Intervlewlng-Its  Forms  and  Functions 
Nev  York:  Basic  Books,  Inc.  / 1965. 


Schein,  Edgar  H.  Organizational  Psychology.  Englewood 
Cliffs,  New  Jersey:  Prentice-Hall,  Inc.,  1970. 

Scott,  Brigadier  General  Winfield  S.,  III.  "Educating 

the  DoD  Program  Manager."  Defense  Management  Journal 
VIII  (April,  1972),  27-31. 


f 

I 


90 


Sttiner,  Q.A.  and  W.G.  Ryan.  Industrial  Project 

Management . New  York:  Macmillan  Company,  1968. 

Stewart,  John  M.  "Ma'cing  Project  Management  Work,” 
Business  Horizons.  VIII  (Pall,  1965),  54-68. 

Strauss,  George  and  Leonard  R.  Sayles.  Personnel:  The 
Human  Problems  of  Management.  Englewood  Cliffs, 

New  Jersey:  Prentice-Hall,  Inc.,  1972. 

Swanson,  A.G.  Selection  of  Project  Managers  in  a 
Government  Research  Laboratory:  A Study  of  the 
Decision  Process."  Sloan  School  of  Management, 
Massachusetts  Institute  of  Technology,  Boston, 
Massachusetts,  1964. 

Talley,  Major  Dorsey  J.  and  Major  Ronald  D.  Patchet. 

"An  Analysis  of  Possible  Improvements  in  the  Staff- 
ing of  System  Program  Offices."  Unpublished  Master’s 
thesis.  School  of  Systems  and  Logistics,  Wright- 
Patterson  APB,  Ohio,  1971. 

Thompson,  Lt  Colonel  Allen  W. , Major  John  H.  Allen, 

Captain  John  D.  Bell,  Captain  Richard  R.  Cadena, 
Captain  Eldon  T.  Winston,  and  William  R.  Gerstlauer. 
"Is  Specialized  Training  Required  for  Newly  Assigned 
System  Program  Office  Personnel?"  Unpublished 
Research  Paper,  School  of  Systems  and  Logistics, 
Wright-Patterson  AFB,  Ohio,  1965. 
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Major  Smythe  entered  active  duty  in  November,  1958 
and  received  a commission  in  the  Air  Force  upon  completion 
of  Navigator  training  at  Harlingen  AFB,  Texas  in  December 
1959*  He  attended  the  Electronic  Warfare  Training  School 
at  Keesler  AFB,  Mississippi,  and  subsequently  served  tours 
as  a B-52  Electronic  Warfare  Officer  at  bases  in  California, 
New  Mexico,  Texas,  and  North  Dakota.  His  most  recent 
assignment  was  B-52  Electronic  Warfare  Officer  Flightlir.e 
Instructor/Evaluator  at  Castle  AFB,  California.  His 
assignment  after  graduation  is  to  Osan  Air  Base,  Korea,  as 
an  Emergency  Actions  Controller. 
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7. 
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Captain  McMullan  entered  active  duty  in  June  i960. 
He  was  an  enlisted  member  for  nine  years  assigned  duty  in 
aircraft  maintenance  in  Illinois,  Delaware  and  Guam. 

Under  the  sponsorship  of  the  Airman  Education  and 
Commissioning  Program  (AECP)  he  attended  Indiana  University 
graduating  in  1969  with  a B.S.  in  Industrial  Management  and 
a commission  in  the  Air  Force.  After  serving  a tour  as 
Range  Logistics  Officer  for  the  Space  and  Missile  Test 
Center  (SAMTEC)  Vandenberg  AFB,  California  he  was  trans- 
ferred to  the  Short  Range  Attack  Missile  (SRAM)  SPO  at 
Wright-Patterson  AFB,  Ohio  as  the  Test  and  Deployment 
Logistics  Officer,  Upon  graduation  Captain  McMullan* s 
assignment  is  to  the  388th  Tactical  Fighcer  Wing,  Korat 
AFB,  Thailand  as  the  Wing  Logistics  Officer. 
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